Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable failing SEACAS tests on Mutrino (#3183) #3213

Merged
merged 1 commit into from
Aug 1, 2018
Merged

Disable failing SEACAS tests on Mutrino (#3183) #3213

merged 1 commit into from
Aug 1, 2018

Conversation

gsjaardema
Copy link
Contributor

@gsjaardema gsjaardema commented Jul 31, 2018

The executables are built in a parallel build, but they are
really serial so when run there is some extra info that is
output to stderr which ends up messing with the textual comparison
with the expected "gold" output files. For now disable the tests
until can figure out a better way of running them.

This should address #3183.

@trilinos/seacas

Description

Motivation and Context

How Has This Been Tested?

Checklist

  • My commit messages mention the appropriate GitHub issue numbers.
  • My code follows the code style of the affected package(s).
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the code contribution guidelines for this project.
  • I have added tests to cover my changes.
  • All new and existing tests passed.
  • No new compiler warnings were introduced.
  • These changes break backwards compatibility.

The executables are built in a parallel build, but they are
really serial so when run there is some extra info that is
output to stderr which ends up messing with the textual comparison
with the expected "gold" output files.  For now disable the tests
until can figure out a better way of running them.
@gsjaardema gsjaardema added pkg: seacas client: ATDM Any issue primarily impacting the ATDM project labels Jul 31, 2018
@gsjaardema gsjaardema self-assigned this Jul 31, 2018
@bartlettroscoe bartlettroscoe added the stage: in progress Work on the issue has started label Jul 31, 2018
Copy link
Member

@bartlettroscoe bartlettroscoe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gsjaardema, this will work. But I was thinking that with so many test disables, that the approach of using a single *.cmake file and then including it in the two tweaks files documented here might have been a better approach. But this is easy to clean up later if we care to do so.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 1235
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 929
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_intel_17.0.1

  • Build Num: 480
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Using Repos:

Repo: TRILINOS (gsjaardema/Trilinos)
  • Branch: seacas-disable-mutrino-test
  • SHA: 74f361b
  • Mode: TEST_REPO

Pull Request Author: gsjaardema

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 1235
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 929
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_intel_17.0.1

  • Build Num: 480
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55


CDash Test Results for PR# 3213.

@bartlettroscoe bartlettroscoe added the AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration label Aug 1, 2018
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 1237
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 931
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_intel_17.0.1

  • Build Num: 482
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Using Repos:

Repo: TRILINOS (gsjaardema/Trilinos)
  • Branch: seacas-disable-mutrino-test
  • SHA: 74f361b
  • Mode: TEST_REPO

Pull Request Author: gsjaardema

Copy link
Contributor

@mhoemmen mhoemmen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @gsjaardema ! :D

@gsjaardema
Copy link
Contributor Author

Note: Issue should be #3183 instead of #2815

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 1237
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 931
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_intel_17.0.1

  • Build Num: 482
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55


CDash Test Results for PR# 3213.

@trilinos-autotester trilinos-autotester removed the AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration label Aug 1, 2018
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 1238
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 932
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_intel_17.0.1

  • Build Num: 483
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Using Repos:

Repo: TRILINOS (gsjaardema/Trilinos)
  • Branch: seacas-disable-mutrino-test
  • SHA: 74f361b
  • Mode: TEST_REPO

Pull Request Author: gsjaardema

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 1238
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 932
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55

Build Information

Test Name: Trilinos_pullrequest_intel_17.0.1

  • Build Num: 483
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
PULLREQUESTNUM 3213
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH seacas-disable-mutrino-test
TRILINOS_SOURCE_REPO https://github.com/gsjaardema/Trilinos
TRILINOS_SOURCE_SHA 74f361b
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 300df55


CDash Test Results for PR# 3213.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ bartlettroscoe mhoemmen ]!

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - Master Automerge is disabled (in .cfg file)

@bartlettroscoe bartlettroscoe merged commit 5059d8a into trilinos:develop Aug 1, 2018
@bartlettroscoe bartlettroscoe removed the stage: in progress Work on the issue has started label Aug 1, 2018
@bartlettroscoe
Copy link
Member

FYI: I took the auto PR tester three PR testing iterations of 4+ hours each where each PR testing iteration uses 3 Jenkins test machines per PR testing iteration to get a passing set of builds. And this is for a PR that should not have triggered any testing. These types of PRs will not trigger testing builds once #3133 is completed (hopefully by next week). But this does not address the instability of the auto PR testing process.

@bartlettroscoe bartlettroscoe changed the title Disable failing SEACAS tests on Mutrino (#2815) Disable failing SEACAS tests on Mutrino (#3183) Aug 1, 2018
@gsjaardema gsjaardema deleted the seacas-disable-mutrino-test branch August 1, 2018 14:10
tjfulle pushed a commit to tjfulle/Trilinos that referenced this pull request Dec 6, 2018
The executables are built in a parallel build, but they are
really serial so when run there is some extra info that is
output to stderr which ends up messing with the textual comparison
with the expected "gold" output files.  For now disable the tests
until can figure out a better way of running them.

This should address trilinos#3183.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
client: ATDM Any issue primarily impacting the ATDM project pkg: seacas
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants